Nonconvex Penalization Using Laplace Exponents and Concave Conjugates
نویسندگان
چکیده
In this paper we study sparsity-inducing nonconvex penalty functions using Lévy processes. We define such a penalty as the Laplace exponent of a subordinator. Accordingly, we propose a novel approach for the construction of sparsityinducing nonconvex penalties. Particularly, we show that the nonconvex logarithmic (LOG) and exponential (EXP) penalty functions are the Laplace exponents of Gamma and compound Poisson subordinators, respectively. Additionally, we explore the concave conjugate of nonconvex penalties. We find that the LOG and EXP penalties are the concave conjugates of negative Kullback-Leiber (KL) distance functions. Furthermore, the relationship between these two penalties is due to asymmetricity of the KL distance.
منابع مشابه
EXISTENCE AND MULTIPLICITY OF SOLUTIONS FOR DEGENERATE p(x)-LAPLACE EQUATIONS INVOLVING CONCAVE-CONVEX TYPE NONLINEARITIES WITH TWO PARAMETERS
We show the existence of two nontrivial nonnegative solutions and infinitely many solutions for degenerate p(x)-Laplace equations involving concaveconvex type nonlinearities with two parameters. By investigating the order of concave and convex terms and using a variational method, we determine the existence according to the range of each parameter. Some Caffarelli-Kohn-Nirenberg type problems w...
متن کاملA Concave Conjugate Approach for Nonconvex Penalized Regression with the MCP Penalty
The minimax concave plus penalty (MCP) has been demonstrated to be effective in nonconvex penalization for feature selection. In this paper we propose a novel construction approach for MCP. In particular, we show that MCP can be derived from a concave conjugate of the Euclidean distance function. This construction approach in turn leads us to an augmented Lagrange multiplier method for solving ...
متن کاملStrong Oracle Optimality of Folded Concave Penalized Estimation By
Folded concave penalization methods have been shown to enjoy the strong oracle property for high-dimensional sparse estimation. However, a folded concave penalization problem usually has multiple local solutions and the oracle property is established only for one of the unknown local solutions. A challenging fundamental issue still remains that it is not clear whether the local optimum computed...
متن کاملEP-GIG Priors and Applications in Bayesian Sparse Learning
In this paper we propose a novel framework for the construction of sparsity-inducing priors. In particular, we define such priors as a mixture of exponential power distributions with a generalized inverse Gaussian density (EP-GIG). EP-GIG is a variant of generalized hyperbolic distributions, and the special cases include Gaussian scale mixtures and Laplace scale mixtures. Furthermore, Laplace s...
متن کاملA geometric framework for nonconvex optimization duality using augmented lagrangian functions
We provide a unifying geometric framework for the analysis of general classes of duality schemes and penalty methods for nonconvex constrained optimization problems. We present a separation result for nonconvex sets via general concave surfaces. We use this separation result to provide necessary and sufficient conditions for establishing strong duality between geometric primal and dual problems...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012